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Abstract — In this paper, coset codes are considered as termi- 
nated convolutional codes. Based on this approach, three new 
general results are presented. First, it is shown that the iterative 
squaring construction can equivalently be defined from a con- 
volutional code whose trellis terminates. This convolutional code 
determines a simple encoder for the coset code considered, and 
the state and branch labelings of the associated trellis diagram 
become straightforward. Also, from the generator matrix of the 
code in its convolutional code form, much information about 
the trade-off between the state connectivity and complexity at 
each section, and the parallel structure of the trellis, is directly 
available. Based on this generator matrix, it is shown that the 
parallel branches in the trellis diagram of the convolutional code 
represent the same coset code C\ of smaller dimension and 
shorter length. Utilizing this fact, a two-stage optimum trellis 
decoding method is devised. The first stage decodes C \ while 
the second stage decodes the associated convolutional code, using 
the branch metrics delivered by stage 1. Finally, a bidirectional 
decoding of each received block starting at both ends is presented. 
If about the same number of computations is required, this 
approach remains very attractive from a practical point of view 
as it roughly doubles the decoding speed. This fact is particularly 
interesting whenever the second half of the trellis is the mirror 
image of the first half, since the same decoder can be implemented 
for both parts. 


I. Introduction 

A NY binary convolutional code of constraint length L (or 
memory order L — 1) whose associated trellis diagram 
terminates after encoding x blocks of k information bits 
into x blocks of n transmitted symbols generates an (n(: r + 
L - 1), kx) binary block code. Although the resulting code 
generally has a smaller minimum Hamming distance than 
the best (n(x + L - l),fcx) block codes, both its encoding 
and decoding can be realized very efficiently. The encoder 
consits of v memory elements and binary adders whose outputs 
are serialized with a low-order multiplexer [1]. The Viterbi 
algorithm (VA) working on the associated 2^-state trellis 
diagram can be implemented at the decoding end [2]. On 
the other hand, while any good binary block code has a 
trellis structure and can also be decoded with the VA [3], the 
implementation of this approach is often not practical due to 
the large state and branch complexities. In general, the number 
of states in the trellis diagram associated with an ( N, K ) block 
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code with large N, K and N - K is very large and upper 
bounded by 2 xn ' n<<K ^~ K \ Finding good block codes with 
simple trellis structure remains an area of on-going research. 

In [4], Forney proposed different decompositions for fam- 
ilies of block codes, namely coset codes, for which the 
associated trellis diagrams have a much smaller number of 
states than 2 min ^ K ' N ~ K \ These decompositions are referred 
as iterative squaring constructions and applied primarily to 
Reed-Muller (RM) codes. Implementing the Viterbi decoding 
algorithm for this class of decomposable codes becomes 
manageable for moderate code length. The associated trellis 
diagram consists of structurally identical parallel subtrellises 
without cross-connections between them, each subtrellis corre- 
sponding to a particular coset of the code. However, the coset 
decomposition and the associated trellis structure presented 
in [4] provide little information about the state and branch 
labelings of each subtrellis. 

In this paper, we first propose an equivalent representation 
of the decomposition of RM codes based on the iterative 
squaring construction to that given in [4]. From this new repre- 
sentation, we show that each subtrellis corresponds to the same 
embedded convolutional code, which implicitly determines the 
state and branch labelings. Also, simple encoders for RM 
codes can be devised from this representation. Generalizations 
to decomposable codes other than RM codes are briefly 
discussed. The second part of the paper presents a two- 
stage optimum trellis decoding for coset codes. This decoding 
is based on the fact that each transition in the embedded 
convolutional code trellis represents the same smaller coset 
code. This smaller code is therefore first decoded and then 
the survivor determines the associated branch metric for the 
trellis decoding of the convolutional code. In the last part of 
the paper, we exploit the fact that the trellis diagram associated 
with any block code teminates and show that a bi-directional 
decoding of the received sequence is possible. This decoding 
method reduces the decoding delay by a factor of two. This 
approach is particularly interesting whenever the same trellis 
diagram can be used for searching from both ends. We show 
that such is the case for RM codes. 

II. Iterative Squaring Constructions of RM Codes 
A. Definitions 

We denote by RM(r.m) the rth order RM code with 
generator matrix length AT( r ,m) — dimension 

= E- =0 ( 7 ) 311(1 minimum distance d (r>m) = 2 m-r . It 
is well known that RM(r.m) is formed by 2*< r * m >-*( r - 1 ' m > 
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cosets of RM(r - l.m), so that [5] 

( 1 ) 

where C( r , m ) generates the coset representatives of the parti- 
tion RM(r,m)/RM(r - 1 ,m) [4]. C^m) is easily obtained 
from the Boolean representation of G( r , m ) [5, p. 371]. By con- 
vention, we assume G(_ i, m ) = [0], which imposes C( o, m ) = 
G( o.m), and define for r>m,C( rrTn ) — [0]. 

Any convolutional code of rate kjn and constraint length 
L is defined by an infinite matrix of the form [1] 




C{r,m) 

I C7{, — l,m) 



PL2 

Pli 


Pll~ i 0 0 *** 

R LL — 2 PLL - 1 0 


where each Pu represents an k x n matrix. We define 


( 2 ) 


Pl — \PloPliPl2 ■ * * Pll-i) ( 3 ) 


By using (1), (4), and elementary row operations, we can 
rewrite (5) as 


G( r ,m) 


^(r,m— 1) ^(r,m— 1) 

A(r,m)( 1) 0 

o Pl(r,m) ( f ) 


( 6 ) 


After repeating the same decomposition for each matrix of (5) 
and applying elementary row operations, we obtain 


^(r.m) — 


G(t,tti— 2) 

G{r.m — 2) 

G(r,m— 2) 

(^(r,m — 2) 

*1 

1 

■*3 

i 

to 

G(r— l,m — 2) 

G^r— 1 .m— 2) 

G(r— l,m— 2) 

0 

G(r — l.m— 2) 

0 

G(r— l,m— 2) 

0 

0 

G( r — l,m— 2) 

G(t— l,m— 2) 

A(r,m)(2) 

0 

0 

0 

0 

Pl{r,m)( 2) 

0 

0 

0 

0 

Pl(r,m) (2) 

0 

0 

0 

0 

Pl(r,m) (2) 


as the generator pattern of length L associated with the 
convolutional code. 

Utilizing these basic definitions, we explore the iterative 
squaring construction of RM codes, as defined in [4]. For each 
level / of decomposition, we show that different convolutional 
codes can be associated with the trellis diagrams described in 
[4]. For a given level /, each convolutional code is defined 
by a generating pattern of different length L, referred to as 
the /- level generating pattern of length L. Based on each 
embedded code, the branch and state labelings of the trellis 
become straightforward. Also, simple encoders for RM codes 
are devised from each associated convolutional code. 

To keep the generality of the results presented in the 
following sections, many indexes and variables are used to 
describe different decompositions. According to the previous 
notations, G refers to the generator matrix of a RM code, C 
refers to coset selectors and P refers to a generator pattern. 
For a given decomposition, we express G( r<m ) in terms of 
these three parameters. In general, P defines the convolutional 
code considered and C describes the number of such codes 
in parallel. Also, if the convolutional code contains parallel 
branches, the parameter G is used to represent them. This 
general guideline is used to describe the decompositions 
presented in the following sections. 


B. I -level Generating Pattern of Length 1 

The /-level generating pattern of length 1 is defined as 

P 1 (r T m)(0 — ^(r— /) (^) 


which defines a trivial convolutional code of zero memory 
order. Its associated trellis diagram contains a single state 
and the parallel branches compose the unique 

transition. These parallel branches define the RM(r — /, m— /) 
code. 

Based on the one-level squaring construction or equivalently 
\u\u + v\ construction, G( r m ) is of the form [4] 




G(r,m — 1) £*(r,m — 1) 

0 ^(r-l,m-l) 


( 5 ) 


Equation (7) represents the two-level squaring construction 
[4], This simple construction can be repeated iteratively. To 
the /-level squaring construction corresponds an /-level coset 
decomposition RM(r,m—l)/RM (r— l,m— /)/ • > ■ /RM(r- 
/, m — /) which is described in detail in [4]. For each coset, we 
obtain 2 l independent sections representing the RM(r — Lm — 
/) code. The advantage of this approach is the independence of 
the 2 l sections which can be exploited to speed up the decoding 
process [6]. However, the number of cosets increases rapidly. 


C. I -level Generating Pattern of Length 2 
The /-level generating pattern of length 2 is defined as 

P2(r,m)(l) = [^2O(r,m)(0 ^21{r,m)(0] (8) 


where 


P 20 (r,m)(0 


G T — — /) 


^21(r,m)(0 — 


0 

G r — i+l,m— t) 


( 9 ) 

( 10 ) 


for / < r. For / > r, we simply define P 20 (r,m)(Z) = 
^2i(r,m)(0 = G (0) m-o- ^ P attem F 2 (r ,m)(0 represents 
a rate R = convolutional code whose 

encoder contains K( r -i+i >vn -i) - K r ^i iTn -i) shift registers, 
each connected to a different input. Due to the repetition 
of the matrix in P 2 (r,m)(Z), the convolutional 

encoding can also be viewed as a differential encoding of 
AT( r _z+i |Tn _/) - A^( r _i, m _i) bits of the information sequence. 
This fact also implies that any x K( r -i+i ytn -i) 

determinant obtained from Pvt, m )(/) has the common factor 
1 + D. Thus, based on Theorem 2 of [7], P 2 (r,m)(Z) describes 
a catastrophic encoder. In general, catastrophic encoders must 
be avoided when convolutional codes are decoded with the 
VA. Also a minimal encoder is implemented as it defines 
the convolutional code C with minimum complexity over all 
polynomial encoders that generate C [8], [9]. However, a 
catastrophic encoder can be used in our case as the trellis 
terminates. This encoder is not minimal but it is known that 
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for a given complexity, a catastrophic encoder may generate 
a code with a larger row distance d row than the free distance 
df ree of any code with a minimum encoder [10]. 1 These facts 
are observed in all decompositions presented in this paper. 

When using (8M10), we can rewrite (6) as 

£(r,m) = 

The corresponding encoder is represented in Fig. 1. The asso- 
ciated trellis diagram has two sections corresponding to two 
encoding stages. At the first stage, we assume the shift registers 
are empty and we encode input bits. Then, at the 

second stage, only if( r _i, m _i) bits enter the encoder at the 
inputs without shift registers. After this second stage, the shift 
registers are all cleared, which terminates the trellis. Since at 
both stages, the i) inputs without shift registers are 

independent of the memory contents, each transition between 
two trellis states consists of parallel branches. This 

trellis diagram is identical to the diagram represented in Fig. 3 
of [4]. However, based on the embedded convolutional code, 
both the state and branch labelings of this figure are immediate. 

Similarly, for the two-level squaring construction, after 
elementary row operations, (7) becomes 

— 

— 2 ) 

^20(r,m)(2) 

0 
0 
0 

( 12 ) 


G{r,m — 2) 

•^2l(r,m) (2) 
^20(r,m) (2) 
0 
0 


^(r,m — 2) 

0 

^21(r.m)(2) 

^20(r,m)(2) 

0 


(■'(r.m — 2) 

0 

0 

^21(r,m)(2) 

G(r~ 2 .m — J 


^20 (r.m)(l) P\ 


21(r,77i)(l) 
T (r— l.m-1) 


(ID 


Another representation of (12) is 


r (r.m) — 

|" — 2) 

0 

P 20(r.m) (2) 
0 
0 
0 


^(r,m— 2) 
^(r— l,m — 2) 
-^21(r,m) (2) 

G( r -2,m-2) 

0 

0 


(■'(r,m — 2) 
('(i — 1 . m — 2) 
0 
0 

^20(r.m)(2) 

0 


C( r ,m-2) 

0 

0 

0 

P 21(r,m) (2) 

G(r-2,m-2) -• 


(13) 


Based on (13), the same encoding procedure is used, with the 
exception that all shift registers are also cleared at the second 
stage. Therefore, the if(r-i,m- 2 ) -#( r - 2 ,m- 2 ) corresponding 
inputs are set to zero at the second encoding stage and the 
corresponding input bits now determine a second level coset 
decomposition based on the decomposition RM(r — l,m — 
2)/RM(r-2.m-2). With respect to the previous four-section 
trellis, the number of cosets increases to 2 K < T ‘ m - 2 '>~ K < r ~ 2 • m - 2 > , 
but the first two sections become independent of the two last 
ones. Generalizing (13) to the /-level squaring construction, 
cosets based on the decomposition RM(r — l + l,m — 
l)/RM(r - /, m - /) can be added to the decomposition of [4] 
to obtain independent subsections. This fact can be exploited 
in the implementation of the decoder. 

1) Example 1 — RM(1, 3) and First Order RM Codes: For 
the two-level squaring construction of the (8, 4, 4) RM code, 
we identify the coset selector 


<?(!,!) = [0 1] 


04) 


Equation (12) indicates that RM(r,m) can be viewed as the 
union of l cosets of a convolutional code 

whose trellis terminates after encoding every block of K^ TyTn ) 
bits. Within each coset, the associated encoder is similar to the 
encoder of Fig. 1, when substituting the appropriate generator 
matrices obtained from (8). The associated trellis diagram is 
equivalent to Fig. 6 of [4]. At the transmitting end, the coset 
representative selected by the first AT( r m _2) ~ K{r-i,m- 2 ) 
uncoded bits is added to each of the four encoded subblocks 
delivered by the convolutional encoder. At the receiving end, 
the 2 K ( r ' m - 2 ) -K ( r - 1 ’ m ~ 2 > possible contributions of each coset 
representative must be removed from the received sequence. 2 
Then, each modified sequence is decoded independently using 
the VA working on the terminated trellis associated with the 
embedded convolutional code. Again, this construction can be 
repeated iteratively. Generalizing (12) to the /-level squaring 
construction, we obtain for each coset a 2 l -section trellis 
diagram corresponding to the terminated convolutional code 
with /-level generating pattern P 2 (r,m)(0 f° r the first 2* - 1 
sections. Since the trellis terminates after the (2*)th section, 
only the parallel branches corresponding to <7( r _ z?Tn _/) remain 
for this last section. 

Mn general <2f ree < d row , and d( Tce = d ro w if the encoder is not 
catastrophic. 

2 For BPSK signaling normalized to ±1, this is easily realized by inverting 
the sign at every position where the coset representative bit is one. 


and the two generator matrices 

^ 20 ( 1 , 3) (2) — P 2 i(i,3)(2) = [1 !]• (15) 

Also, since G { - 1A) = [0], P 2 o(i,3)(2) = G (0 , i) so that only 
the second stage with shift registers remains with respect to 
Fig. 1. The corresponding rate 1/2 encoder and trellis diagram 
are shown in Fig. 2. We can verify easily that the encoder 
of the embedded convolutional code is catastrophic. However, 
terminating the trellis breaks the catastrophic behavior. Note 
finally that for this code, no additional bits are encoded during 
the terminating stage, or equivalently, the trellis diagram 
contains no parallel branches. 

Generalization of this example to the two-level squaring 
construction of any first order RM code is straightforward. For 
i?M(l,m), the coset selector C( i >m -2) is an (m - 2) x 2 m-2 
matrix which defines 2 m-2 different cosets. Both generator 
matrices equal [l 2 m_ 2 ], where l n represents the all-1 n-tuple. 
The corresponding rate l/2 m “ 2 encoder contains a single shift 
register whose input and output are summed at the 2 m “ 2 
outputs of the encoder. 

2 ) Example 2 — RM(2 y 4 ) and Second Order RM Codes: For 
the two-level squaring construction of the (16, 11,4) RM code, 
the matrices in (8)— (10) are the coset selector 

C(2,2) = [0 0 0 1] (16) 
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Fig. 1. Convolutional code encoder for one-level squaring construction. 




(b) 

Fig. 2. (8, 4, 4) RM code, (a) Encoder and (b) trellis diagram. 


and the two generator matrices 

" 1111 “ 
* 20 ( 2 , 4 ) ( 2 ) = 0 0 1 1 

0 1 0 1 

"0 0 0 0 “ 

*> 21 ( 2 , 4 ) ( 2 ) = 0 0 11 . 
0 10 1 



(b) 

(18) Pig* 3. (16, 11, 4) RM code, (a) Encoder and (b) trellis diagram with 6o = 

V } {0000, 1111}, bi = {0101, 1010), 62 = {0011, 1100}, 63 = {0110, 1001}. 


These matrices define a rate 3/4 convolutional code whose 
encoder and trellis diagram are represented in Fig. 3. Since the 
encoder contains only two shift registers, the trellis diagram 
has four states and each transition is represented by two par- 
allel branches. As in the previous example, the convolutional 
code encoder is catastrophic and the catastrophic behavior is 


stopped at the fourth stage if the encoding is realized based on 
(12). However, at that last stage, K(o,i) = 1 bit is encoded. 

The embedded convolutional code and its corresponding 
encoder for the two-level squaring construction of any second 
order RM code can be determined from this example. For 
RM(2,m), the (™“ 2 ) x 2 m_2 matrix C(2,m-2) determines 
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the choice among 2' 2 * coset candidates based on the first 
( m ~ 2 ) of the block to the encoded. Then, the remaining 
bits are encoded in four stages by a rate (m - l)/2 m ~ 2 
convolutional encoder with m — 2 inputs connected to a 
single shift register. At the first three stages, the input and 
output of each shift register are summed. This resulting sum 
is then added to the encoder outputs, based on the matrix 
C(i.m- 2 )- The last input without shift registers is also added 
at all encoder outputs. At the fourth stage, only this input 
is delivered at all encoder outputs, while the shift registers 
are cleared, which terminates the trellis. Due to this input, 
each transition in the trellis is represented by a pair of parallel 
branches. 


D. l-level Generating Pattern of Length 3 

The /-level generating pattern of length 3 is defined as 


j f > 3(r,m)(0 — [^"30(r,m) (0 ^31(r.m)(0 ^32 (r,m)(0 

^33 (r,m)(0] ( 19 > 


where 


^3O(r,m)(0 


^31(r,m) (0 


(r l } m — l) 
G(j — / + l,m— /) 

f^(r — 1+2, m — l) 
0 

G( r — / + l,m — /) 
^0-1 + 2, m-f) 


^ > 20(r,m) (0 
p(r-l+2,m-l) 

P 21 (r,m)(0 
p{r-l+2,m-l) 


P$2 (r,m)(0 — ^33(r-,m)(0 


0 

0 

J + 2,m — I) 


( 20 ) 

( 21 ) 

(22) 


for l < r. If / > r, the conventions introduced in Section II-A 
are applied to the definitions of these matrices. Equation (19) 
defines a rate A r ( r _/_ t _2, T n_/)/2 m ~ / convolutional code. The en- 
coder contains K( r -i+ 2 ,m-i) inputs connected 

to shift registers of length three, 

inputs connected to a single shift register and Af( r _j , m -/) 
without memory elements. The complete trellis diagram is 
composed of 2 3A < r -*+ 2 * m -o -2A V-i+i.™-i>” A (’“-L™-o states. 
However, in the following decompositions, the inputs con- 
nected to the shift registers of length three are not activated 
at each stage, so that the number of states in the trellis 
diagram is less than this maximum number. The convolutional 
code generated by m )(/) also corresponds to a differential 


encoding and its encoder is catastrophic since 1 + D is a factor 
of each determinant for Theorem 2 of [7]. 

Using these definitions, (12) can be rewritten as 


G(r,m) — 


-^30(r.m) (2) 

P&X (r.m) (2) 

P 32(r.m)(2) 

^33(r.m)(2) ' 

0 

■^20(r.m) (2) 

P 21(r.m) (2) 

0 

0 

0 

^20(r.m)(2) 

P 21(r,m) (2) 

0 

0 

0 

G( r — 2.m-2) - 


(23) 

From (23), we verify that the inputs connected to the shift 
registers of length three are activated only during the first 
stage, so that the number of states in the trellis diagram 
remains constant up to termination. For each stages, the com- 
plete trellis diagram consists of 2 A <’"™- 2 >“ A < r - 1 - m - 2 ) parallel 
subtrellises with the same branch labeling, due to the repetition 
of C( r r n—2) in ^3(r\m)(2). Therefore, this trellis is equivalent 
to the union of the trellises corresponding to (12). The inputs to 
the shift registers of length three determine the coset selection 
associated with (12). 

Based on the three-level squaring construction of G( r?m ), 
the matrix G( r?m ) can be put into the following form (see 
matrix at the bottom of this page). This matrix defines 
2/c ( r.m-3)-tf<r-2,m-3) parallel subtrellises. The inputs to the 
shift registers of length three are activated at stages 1, 3, and 5. 
Since stages 1 and 5 are independent, the number of states in 
the trellis increases only at stage 3. Also, parallel subtrellises 
are observed in stages 2, 4, and 6. A more regular trellis 
diagram is obtained when considering the previous matrix as 
shown at the bottom of the next page. 

The corresponding number of cosets increases to 
2 Ar (^m-3)+^(r-i,*n-3)-2K (r _2.m-3) but the trellis diagram 
becomes much more regular, as shown in Fig. 4. Each stage 
from 1 to 7, except stage 5, contains 2 A ( r - 1 m ~ 3 )“ A < r ~ 3 rri - 3 > 
states, while only 2 Ar < r - 2 * m - 3 > _A '( r - 3r,l - 3 > states are present 
at stage 5 for which all blocks of three serial registers are 
cleared. We finally notice that stages 2, 3, 6, and 7 are 
composed of 2 A(r - l m 3)-A(r " 2 m_3} parallel subtrellises with 
the same branch labeling. 

1) Example 3 — RM{ 3, 5) and RM( 3, 6): For the (32, 
26, 4) RM code, the last decomposition provides four subtrel- 
lises of the form depicted in Fig. 4. All inner stages but stage 5 
contain two parallel sub-subtrellises of four states each, where 
a sub-subtrellis is defined as a subtrellis within another larger 


0 

^30(r,m)(3) 

0 

0 

0 

0 

0 

0 

0 


G( r)Tn _ 3 ) 
— 1 ,m — 3) 
^31(r,m)(3) 

P 20(r,m) (3) 
0 
0 
0 
0 
0 
0 


G( r<m _ 3 ) 

— l,m— 3) 

^32(r,m)(3) 

^21(r,m)(3) 

^30(r,m)(3) 

0 

0 

0 

0 

0 


G( r>Tn — 3 ) G( rfn _ 3 ) G( r>m _ 3 ) 

0 0 C( r _ liTn _3) 

P 33(r , yn) (3) 0 0 

0 0 0 

-^31 (r,m) (3) Pz2(r,m) (3) E > 33(r,m)(3) 
^20(r,m)(3) p21(r,m)(3) 0 

0 ^30(f\m)(3) ^31(r,m)(3) 

0 0 ^20(r,m)(3) 

0 0 0 

0 0 0 


G( r>m _3) 
G( r _ l,m — 3) 
0 
0 
0 
0 


^32(r,m)(3) 

^21(r,m)(3) 

^20(r.m)(3) 

0 


G( r.m— 3 ) 

0 

0 

0 

0 

0 

P 33(r 1 m)(3) 

0 

^2l(r,m)(3) 

G( r _3, m _3) - 
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K(r-l.m-3)-K(r-3 t m-3) K(r-Zm-3)-K(r-3,m-3) 

2 2 



Fig. 4. Structure of each subtrellis associated with the convolutional code obtained from the second version of the generator matrix associated with the 
third order generating pattern of level three. 


subtrellis. The same structure applies to the (64, 42, 8) RM 
code. The complete trellis contains 128 subtrellises formed 
of eight 8-state fully connected sub-subtrellises at all but the 
fifth inner stages. 

E. I -level Generating Pattern of Length L 

Based on the previous section, a generalization to the /- 
level generating pattern of length L for L > 4, is possible. 
Generalizing (19M22), we have 

^L(r,m)(0 = PL(r+i,m+i)(l + *)• (24) 

This results in the following theorem which shows that the 
embedded convolutional code based on the /-level generating 
pattern of length L depends only on the differences r - l and 
m — L 

Theorem 2.1: The embedded convolutional code associated 
with the /-level generating pattern of length L applied to 
RM(r,m) is the same as the embedded convolutional code 
associated with the (/+/)- level generating pattern of length 
L applied to RM(r + i, m -b i). 

F. Family of Codes Corresponding to the l -level 
Generating Pattern of Length L 

As given in (3), P defines an infinite family of (n(rr + 
L - 1), kx) block codes obtained by terminating the encoding 
of the associated convolutional code after x blocks of k 


information bits. The decoding complexity for each code of 
this family is fixed. Similarly, an infinite family of block codes 
can be associated with the /-level generating pattern of length 
L. For example, based on (12), the two-level generating pattern 
of length 2 obtained from RM(r , m) defines a family of codes 
with 

TV = 2 m ~ 2 x 

K — (x — l)K(r — 1, m — 2) + |x/4j 
• ( K(r , m — 2) — K(r — 1, m — 2)) 

-h K(r — 2, m - 2) 

d H =2 m ~ r . (25) 

To maintain the same decoding complexity as in (12), the 
coset selector inputs are activated independently every four 
blocks. Generalizations to other generating patterns follow in 
a similar way. 

For RM( 2,5) in the previous example, we identify the 
(8x,4(x — 1) -I- 3[ar/4j + 1,8) codes. This family contains 
the (8, 1, 8), (16, 5, 8) and (32, 16, 8) RM codes. Also, for 
x = 8, we verify that the corresponding (64, 35, 8) code is 
a subcode of the (64, 42, 8). Based on [4], we evaluate that 
6,704 real operations are required for trellis decoding of this 
subcode. With respect to the (32, 16, 8) RM code, the average 
computational complexity per bit increases from 150 to 192 
real operations for a 0.32 dB coding gain at the bit-error rate 


^(r,m— 3) 

0 

0 

P 30(r,m) (3) 
0 
0 
0 
0 
0 
0 
0 


C(r,m— 3) 
C( r -l,m-3) 
0 

-^31(r,m) (3) 
^20(r.m)(3) 
0 
0 
0 
0 
0 
0 


— 3) 
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^-'(r— 1 ,m — 3) 

^32(r,m)(3) 
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0 
0 
0 
0 
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3) 

0 
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f33(r,m)(3) 
0 

p21(r,m) ( 3 ) 
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0 
0 
0 
0 
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0 
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0 
0 
0 

^21(r,m)(3) 

^30(r,m)(3) 

0 

0 

0 


3) 3) ^(r,m — 3) 

^-'(r — l.m— 3) £*(r — l,m— 3) 0 

C(r-l,m-3) 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

^31(r,m) (3) ^32( r , m ) (3) P33{r,m) (3) 

^20(r,m)(3) F21( r , m )(3) 0 
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Fig. 5. Error performance comparison for the (32, 16, 8), (64, 35, 8), and (64, 42, 8) codes. 


(BER) 10~ 6 , as shown in Fig. 5. At the same BER, 0.63 dB 
separates the bit error performance curves of the (32, 16, 8) 
and (64, 42, 8) RM codes as shown in Fig. 5. However, trellis 
decoding of the (64, 42, 8) RM code is realized with 12968 
real operations per bit [4], By fixing the state complexity of 
the trellis, we define a subcode of the RM code of equivalent 
length. Trellis decoding of this subcode can provide a good 
trade-off between error performance and decoding complexity. 

By considering the trellis diagram of the (8x,4(x - 1) + 
3[a:/4j + 1,8) codes, we compute the associated number of 
minimum weight codewords as 

W$(x) = 14a; 2 — 13x + 448|_x/4j. (26) 

Therefore, W$(x) is proportional to x 2 . For convolutional 
codes with a noncatastrophic encoder and row distance 
drow,^ row is proportional to x. As expected, since the 
codes considered have a catastrophic encoder, their number 
of minimum weight codewords increases faster than for 
convolutional codes with a noncatastrophic encoder. On the 
other hand, a larger row distance d row can be achieved. 


G. Extension to Other Related Constructed Codes 


1) The (24 , 72, 8) Golay Code and Related Codes Con- 
structed from the Cubing Construction: The decomposition 
into cosets of a terminated convolutional code can be gen- 
eralized to other families of block codes constructed from 
RM codes. We illustrate this fact with the (24, 12, 8) Golay 
code. Based on the cubing construction, the generator matrix 
£(24,12) of this code can be decomposed as [4] 


£( 24 , 12 ) 


£( 2 , 3 ) £( 2 , 3 ) £( 2 , 3 ) 

^ 20 ( 2 , 5 ) ( 2 ) ^ 21 ( 2 , 5)(2) 0 

0 P 20(2, 5)(2) P 2 1(2, 5)(2) 

0 0 £( 0 , 3 ) - 


Therefore, the encoder of the rate 4/8 convolutional code 
associated with P 2 o(2,5)(2) and P 2 i( 2 ,5)(2) can be used to 
encode the (24, 12, 8) Golay code within any of its eight cosets. 
The VA working on the associated trellis diagram, terminated 
after the third section, can realize the decoding process and 
is described in [4]. Based on the rate 4/8 convolutional code 
encoder, the branch and state labelings of the trellis diagram 
are now immediate. 

2) BCH Codes: Based on the construction summarized in 
Tables I and II of [11], the encoder and associated trellis 
diagram of certain BCH codes are determined as described 
in the previous sections. 

HI. Two-Stage Optimum Trellis 
Decoding of Block Codes 

In Section n, we showed how to relate a particular coset 
decomposition to its corresponding embedded convolutional 
code for RM and related block codes. For many such de- 
compositions, each transition in the trellis diagram associated 
with the corresponding embedded convolutional code consists 
of many parallel branches. In general, each transition cor- 
responds to another shorter RM code of smaller dimension. 
Therefore, the trellis diagram of the corresponding code can 
be substituted for each transition of the trellis diagram of 
the embedded convolutional code. It results in a super-trellis 
diagram containing many more states. In this section, we 
propose to process this trellis diagram in two stages. At the 
first stage, all possible RM codes corresponding to parallel 
branches are processed. Then, each survivor and its metric are 
delivered to the corresponding transitions of the embedded 
convolutional code and the decoding is achieved based on 
the trellis diagram of this convolutional code only. The first 
stage of this two-stage decoding can be viewed as the branch 




FOSSORIER AND LIN: COSET CODES VIEWED AS TERMINATED CONVOLUTIONAL CODES 


1103 



K(rjn-2)-K(T-2^n«2) 

STAGE 1 : 2 rate R= *(r-l,in-2)-K<r-24n-2) y m-2 

RM (r-2jm-2) Codes. 

Convolutional Codes. 

Fig. 6. Decoder structure for two-stages trellis decoding based on second order generating pattern of level two. 


metric computation associated with the trellis decoding of the 
embedded convolutional code. Note that the decoding method 
presented in [4] is simply a special case of this two-stage 
decoding where the branch metric preprocessing corresponds 
to the first stage decoding of the trivial RM(0,m - r) 
code. 

We now present in detail the two-stage trellis decoding of 
the four-section decomposition obtained from (12). General- 
ization to any other decomposition follows the same lines. As 
described in Section H-C, a 2 i ^ r - 1 * m - 2 >~ A < r - 2 ' m - 2 > -state rate 
R = if( r _ 1( m-2)/2 m-2 convolutional code is associated with 
each coset of this representation. From (12), we observe that 
each parallel transition corresponds to a RM(r — 2,m — 2) 
code. Based on this representation, we identify for each of 
the four sections RM(r - 2,m - 2) 

codes with different labeled trellises, or equivalently the same 
RM(r — 2, m — 2) trellis working on 2 K ( r - rn -^~ K ( r ~ 2 ' rn -^ 
different input sequences. Then, the second stage decoding 
is achieved based on the fully connected trellis diagram of 
the associated rate R = if( r -i,m- 2 ) — tf(r-2,m-2)/2 m ~ 2 
convolutional code for each coset. The corresponding imple- 
mentation is shown in Fig. 6. The two-stage decoder rep- 
resented in this figure is simply realized with a parallel 
implementation of respectively the same coset code and the 
same convolutional code. If the number of these component 
codes remains moderate, a low-cost decoder can be built. 

1) Example 4 — RM{ 3, 5) and RM(S, 6): The first stage 
decoding of the (32, 26, 4) RM code requires the decoding of 
16 (8, 4, 4) RM codes per section, each of them being achieved 
with 23 real operations when using conventional trellis decod- 


ing [4]. Thus stage 1 requires 1, 472 real operations. Then the 
trellis diagram of the rate jR = 3/8 convolutional code is used 
by each of the two cosets at the second stage, resulting in 51 1 
real operations, so that the complete two-stage trellis decoding 
is realized with 1, 983 real operations. Similarly, the first stage 
decoding of the (64, 42, 8) RM code decodes 1, 024 (16, 5, 8) 
RM codes per section, for a total of 389 120 real operations. 
Then the second stage decoding uses the trellis diagram of 
the fully connected R = 6/16 associated convolutional code 
in each of the 16 cosets of the decompositon. This second 
stage decoding is realized in 262 143 real operations. The total 
number of real operations for this codes becomes 651 263. 

For comparison, the trellis decoding based on [4] uses an 
eight-section trellis decomposition and requires respectively 
1, 271 real operations for the (32, 26, 4) RAM code and 
544640 operations for the (64, 42, 8) RM code, which is 
smaller in both cases. However, for these two codes, for a 
slightly larger computation complexity, a decoder of lower 
cost can be built by considering the two-stage decoding. Also, 
trellis decoding of first order RM codes can be efficiently 
improved without significant decoding delay as shown in [12] 
by considering metric differences only. This scheme is referred 
to as differential trellis decoding (DTD). With this method, 
trellis decoding requires 21 operations for the (8, 4, 4) code 
and 59 instead of 95 real operations for the (16, 5, 8) code. 
Similarly, DTD of the embedded convolutional codes can be 
processed with 335 and 164863 real operations for the rates 
R = 3/8 and R = 6/16, respectively. The corresponding total 
number of operations for two-stage trellis decoding becomes 
1, 679 for the (32, 26, 4) RM code and 406527 for the (64, 
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42, 8) RM code. We finally mention that the computational 
complexity associated with trellis decoding of a given block 
code is generally higher than the decoding complexity of 
maximum likelihood decoding algorithms based on reliability 
information (see [13] for a recent bibliography of contributions 
with this approach). However, these algorithms generally 
required a partial or total ordering of the received sequence and 
do not offer as much parallel structure and regularity as trellis 
decoding, resulting in a larger decoding delay. Nevertheless, 
this additional delay may not be as important when considering 
only the code of smaller dimension decoded at the first stage. 
This suggests a mixed decoding method. For example, the best 
decoding algorithm of the (8, 4, 4) code requires only 17 real 
operations [14] and can be directly obtained from the trellis 
decoding method of [12], so that the (32, 26, 4) is now decoded 
in 1 , 423 real operations with two-stage trellis decoding. These 
particular examples illustrate the difficulty of choosing the best 
decoder implementation for a particular code due to the trade- 
offs between decoding speed, computational complexity and 
implementation cost. 


IV. Two-Way Trellis Decoding of Block Codes 
A. Properties 

Further speedup of trellis decoding of block codes can be 
obtained by exploiting the fact that for each block, the trellis 
terminates. We obtain the following theorem. 

Theorem 4.1: Consider a trellis T from the original node 
O to the terminating node S', with N(s) nodes at the end of 
each section s. Then, the minimum metric M m - in in state S is 
equal to the minimum of the N(s) sums M~ (t) 4- M + (z), i £ 
[1, N(s)], where M~{i) represents the minimum metric from 
state O to the zth node of the end of section s, and (z) 
represents the minimum metric from the zth node of the end 
of section s to state 5. 

Proof: By definition 

M min = min { M(p ) } (28) 

pG*- 


Therefore, (30) can be rewritten as 

Mnin = . min { min {M(p~)} 

i€[l,N(.s)] p £n(i)- 

+ min {M(p + )}} (32) 

p+e* r(i)+ 

which completes the proof. □ 

Theorem 4.1 implies that the trellis decoding of the received 
sequence (t/i, p 2 ? • * • > J/jv) can t> e processed independently 
based on the trellis T~ from the origin node to section s for 
(yi i S/2 t * * * « Vs ) and based on the mirror image T + of the trellis 
from section s to the final node 5 for the reverse sequence 
(t/jv, Vn-u ■ ■ ■ ,z/ s +i), Then, at each node of section s, the 
two metrics are summed and the minimum of these sums deter- 
mines the decoded sequence. With this approach, for s > 2, we 
no longer compute the metric candidates for the last two stages 
of the complete trellis, which correspond to the first stage of 
the mirror trellis, but we compute twice the metric candidates 
at each node of section s. In general, we choose s = Nj 2 and 
for faster decoding, the encoded sequence (xi,X2 , ••■,xjv) 
can be interleaved to (xi,xjv,a:2»£Ar-i, • * • ^72,^72+1) 
before transmission. Also, for all but the merging section 
s, smaller cumulative metric values are carried out when 
decoding the second part of the received sequence. 

B Application to Decoding of RM (r. m) Based 
on the r -level Squaring Construction 

In general, the trellises T~ and T + defined in Section 
IV- A are different. In this section, we show that the same 
trellis diagram can be used to decode (3/1, y 2 , • * * , Vn/ 2) and 
(VNiVn- 1, * * • ,Vn/ 2+1) for die r-level squaring construction 
of RM(r,m). 

For any A x B matrix M — [rriij],i € [l,A],j £ [1,B], 
we define the operators a(-) and /?(*) as 

a(M) = [m. 4 _ t+ ij] 

0(M) = [m lyB -i+ 1] (33) 

and the binary matrix 

AT = M 0 [1a, b] (34) 


where 7 r represents the set of all paths from node O to node 
S in T, and M(p) is the metric associated with path p. If 
7 r(i) denotes the set of paths p £ 7r containing state i, then, 
for section s 

U *(*) = * (29) 

i€[l ,N(s)) 

which implies 


where [1a, b] represents the A x B all-1 matrix. If C( l m ) 
is expressed in its conventional Boolean form, we can easily 
show that 

mi.m)) = C ( V m) . (35) 

We consider the decomposition obtained when generalizing 
(12). Evaluating (8) for r = l implies that RM(r,m) can be 
generated either by the generating pattern 


M min = min {_min {M(p)}|. 

i€[l,!V(s)] p€7r(z) 




1 2 m — f 0 

fs(\ ,m— r) ,m— r) a . 


(36) 


For each state i £ [1, N(s)] of section s, we define 7r(z)~ as or after adding l 2 m-< to each row of C( l m _ r ), by the 
the set of paths from state O to state z, and 7r ( z)+ as the set generating pattern 
of paths from state i to S. Then 

Vp £ 7r(z),3(p“,p + ) £ tt(z) _ x 7r(z) + :p = \jT\p*]- (31) 


1 2m — i 0 

.^(l,m-r) ^(1 ,m~r) m 
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If P^ r m) (r) is the chosen generating pattern, we observe that 
(VNiJJN-u ' ‘ * j2/A r /2+i) can be decoded within each coset 
from the trellis diagram associated with the generating pattern 




0 lom — f 


a(/3(C (1 , m _ r) )) a(/3(C ( * lm _ r) )). 


lom — i 


. a (C(l,m-r)) a (^(l.rn-r)) 


(38) 


From (37) and (38), we conclude that the same trellis di- 
agram can be used when searching the closest paths to 
— *yjv/2) and (yN,yjv-i,-‘*,lfor/2+i) with the VA. 
However, each subblock of the decoded sequence correspond- 
ing to (yiv,yN-i»“-,y^/2+i) must be permuted according 
to (38). 

Another solution is to keep the generating pattern of (36), 
and therefore the general encoder structure depicted in Fig. 1 
which is somehow easier to implement. The generating pattern 
for the sequence (yjv,yjv- 1? * • ■ > Vn/2+i) dien becomes 


•ftp 


(l.m — r) 
0 

1 2™-i 


l 2 n 


r’])) 


a(/3(C (Um - r} )) a(/?(C (1 . ro _ r) ))J' 


(39) 


Equation (39) expresses that each subblock of length 2 m_/ 
must be permuted before being processed by the VA. 
Therefore, the first subblock to be processed becomes 
(yN- 2 ™- l +iiyN- 2 ™- l + 2 j • • • ,yjv-i»yAr)- Note however 
that this permutation can equivalently be realized before 
transmission. Then, the same permutation on the decoded 
sequence as for (38) also applies to this version. Finally 
we mention that the use of the same trellis diagram for 
bidirectional decoding of RM(r , m) also holds for any /-level 
squaring construction. 

1 ) Example 5 — RM(2 , 4): As an example, we consider bi- 
directional decoding of the (16, 11, 4) RM code based on 
the second version. The corresponding encoder and decoding 
trellis diagram are represented in Fig. 3. Let (x\,X 2 , • • , ^ie) 
be the transmitted encoded BPSK sequence representing the 
information sequence (co,Ci, • • • ,Ci 0 ) and (t/i, V 2 , * ■ * ,Vie) 
the corresponding noisy received sequence. Based on (8) 
and (39), within each of the two coset candidates, the VA 
processes independently the subsequences corresponding to 
(2/1, 2/2, •••,2/8) and (2/13, 2/14, 3/15,2/16,2/9,2/10,2/11, 2/12) with 
die trellis diagram of Fig. 3. At each merging state, both 
metrics are added and the minimum determines the surviv- 
ing path for each coset. Assuming Co determines the coset 
selection, the decoded sequence delivered by the VA corre- 
sponds to (ci,c 2 > * • ■ ,c 5 ,c 6 ) for the forward sequence and 
(cio,C8,C9,C7,c 5 ,C6) for the backward sequence, as dictated 
in (39). We then permute the decoded sequence and decode cq 
by choosing the coset with minimum survivor metric. Next we 
compare the number of computations required for bidirectional 
and conventional trellis decoding of each coset of the (16, 11, 
4) RM code. For both decoding cases, we first preprocess each 
of the values ±y 4 i+i ±y 4 i+2±2/4i+3±J/4i+4 for i € [0,3], for 


a total of 4 - 12 = 48 additions [4]. At each trellis state, four 
additions to compute the cumulative metric candidates and 
three comparisons are processed by the VA. In conventional 
trellis decoding, sections two and three have four states and 
section four has 1 state, so a total of 63 real operations 
are required for this method. In bi-directional decoding, 56 
real operations are processed since both second sections have 
four states. Then four additions and three comparisons are 
performed at the merging stage, so that the same number of 
63 real operations is also required for this approach. From 
this example, we conclude that in general, neither significant 
computation gain, nor significant computation loss is achieved 
by bi-directional trellis decoding with respect to conventional 
trellis decoding. However, the decoding process reduces the 
decoding delay by a factor of two, as well as the metric 
memory requirements. 


V. Conclusion 

In this paper, we have shown that the trellis representation 
corresponding to any iterative squaring construction of RM 
codes as described in [4] can be viewed as the union of cosets 
of an embedded terminated convolutional code. For a given 
RM code and a given decomposition, different convolutional 
codes can be defined. We provided the generator polynomials 
of each of these convolutional codes by associating with each 
code a generating pattern. In each case, the same general 
structure of the embedded convolutional code is observed. 
The choice of the code requires a balance in the number 
of shift registers connected to each different input of the 
encoder with the number of cosets. A short generating pattern 
determines only a few shift registers connected to each input, 
which minimizes the code rate loss due to the termination 
of the trellis. However, since many rows of the generator 
matrix are not included in the generating pattern, the number 
of cosets is very large. The corresponding trellis diagrams 
are loosely connected with a high level of parallelism, but 
also a large total number of states whenever the number of 
cosets is important. The number of cosets can be reduced 
by choosing longer generating patterns. However, the encoder 
inputs with many memory elements have to be regularly set 
to zero to prevent a large expansion of the number of states in 
the trellis and maintain an efficient termination of the trellis. 
The complete trellis diagram contains few parallel subtrellises, 
but a high level of connectivity within subtrellises. In all 
considered cases, the convolutional code has a nonminimal 
catastrophic encoder and the catastrophic behavior is stopped 
by terminating the trellis. This guarantees a large row distance 
for the number of trellis states considered. Generalization to 
other codes related to RM codes has also been discussed. 
Based on the embedded convolutional code, the branch and 
state labeling of the trellis representations introduced in [4] 
becomes straightforward. Also, the general structure of this 
trellis is easily obtained from the generating pattern of the 
code. 

We then showed that for a particular representation, the 
associated trellis diagram of each coset can be viewed as the 
trellis diagram of the associated convolutional code, with each 



1106 


IEEE TRANSACTIONS ON COMMUNICATIONS. VOL. 44. NO. 9. SEPTEMBER 1996 


transition representing the same coset code C i of a smaller 
dimension. Therefore, this structure allows a two-stage trellis 
decoding where the first stage computes the branch metrics of 
the associated convolutional code trellis by trellis decoding of 
the code C\. A wide choice of trellis decoding implementation 
is offered by this method. 

Using the fact that for any block code the trellis terminates, 
we also showed that bidirectional decoding of each received 
sequence is possible. Further decoding speed-up is achievable 
with this approach when processing in parallel both ends of 
the received sequence, one forward and one backward. Also, 
this method allows one to carry smaller cumulative metrics 
during the decoding process at all but the merging states for the 
second part of trellis. For the r-level squaring construction of 
any RM(r , m) code, the VA search for both subsequences can 
be realized with the same trellis diagram. However, the order 
of the decoded sequence must be modified for the backward 
search. 


References 

[1] S. Lin and D. J. Costello Jr, Error Control Coding Fundamentals and 
Applications. Englewood Cliffs, NJ: Prentice-Hall, 1983. 

[2] G. D. Forney Jr, “The Viterbi algorithm," Proc. IEEE , vol. 61, pp. 
268-278. Mar. 1973. 

[3] J. K. Wolf, “Efficient maximum likelihood decoding of linear block 
codes using a trellis," IEEE Trans. Inform. Theory , vol. IT-24, pp. 76-80, 
Jan. 1978. 

[4] G. D. Forney Jr, “Coset codes II: binary lattices and related codes," 
IEEE Trans. Inform. Theory , vol. IT-34, pp. 1152-1187, Sept. 1988. 

[5] F. J. MacWilliams and N. J. A. Sloane, The Theory of Error-Correcting 
Codes. Amsterdam, The Netherlands: North-Holland Mathematical 
Library, 1977. 

[6] D. Rhee and S. Lin. “A low complexity and high performance concate- 
nated scheme for high speed satellite communications," NASA Tech. 
Rep., Oct. 1993. 


[7] J. L. Massey and M. K. Sain. “Inverse of linear sequential circuits,” 
IEEE Trans. Compute vol. COMP- 17, pp. 330-337, Apr. 1968. 

[8] G. D. Fomey Jr, “Convolutional Codes I: Algebraic structure," IEEE 
Trans. Inform. Theory . vol. IT- 16, pp. 720-738, Nov. 1970. 

[9] P. Piert, Convolutional Codes , An Algebraic Approach. Cambridge, 
MA: M.I.T. Press, 1988. 

[10] D. J. Costello Jr., “Free distance bounds for convolutional codes," IEEE 
Trans. Inform. Theory , vol. IT-20, pp. 356-365. May 1974. 

[11] A. Vardy and Y. Be'ery, “Maximum likelihood soft decoding decoding 
of BCH codes," IEEE Trans. Inform. Theory , vol. 40, pp. 546-554. 
Mar. 1994. 

[12] M. P. C. Fossorier and S. Lin, “Differential trellis decoding of convo- 
lutional codes," submitted IEEE Trans. Commun.. Jan. 1995. 

[13] “Soft-decision decoding of linear block codes based on ordered 

statistics," IEEE Trans. Inform. Theory , vol. IT-41, pp. 1379-1396, Sept. 
1995. 

[14] M. Ran and J. Snyders, “On maximum likelihood decoding of some 
binary self-dual codes," IEEE Trans. Commun.. vol. 41, pp. 439-446, 
Mar. 1993. 



Marc P. C. Fossorier (S^O-M^) was bom in 
Annemasse, France, on March 8, 1964. He received 
the B.E. degree from the National Institute of Ap- 
plied Sciences (I.N.S.A.) Lyon, France, in 1987, and 
the M.S. and Ph.D. degrees from the University of 
Hawaii, Manoa in 1991 and 1994, all in electrical 
engineering. 

He is currently with the Department of Electrical 
Engineering of the University of Hawaii, where 
he has been an Assistant Professor since January 
1996, and worked as a Postdoctoral Fellow in 1995. 
His research interests include decoding techniques for linear codes, code 
constructions, communication algorithms, magnetic recording, and statistics. 


Shu Lin (F’90), for a photograph and biography, see p. 42 of the January 
1996 issue of this Transactions. 


